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Abstract Let {Un{t))f^]^d be the empirical process associated to an M*^- valued sta- 
tionary process (Xj)j>o. In the present paper, we introduce very general condi- 
tions for weak convergence of {Un{t))teRd, which only involve properties of processes 
(/(Xj))j>n for a restricted class of functions f E Q. Our results significantly improve 
those of ~0 and [3] and provide new applications. 

The central interest in our approach is, that it does not need the indicator func- 
tions, which define the empirical process {Un(t))t^Rd, itself to belong to the class Q. 
This is particularly useful when dealing with data arising from dynamical systems 
or functionals of Markov chains. In the proofs we make use of a new application of 
a chaining argument and generalize ideas first introduced in [sj and j^. 




Finally we will show how our general conditions apply in the case of multiple 
mixing processes of polynomial decrease and causal functions of independent and 
identically distributed processes, which could not be treated by the preceding results 
in and 0. 

1 Introduction 

The present paper concerns the question of the weak convergence of empirical processes under 
weak dependence of the underlying process. Let us consider some stationary M'^-valued proces£] 
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(Xj)jgN- The empirical process of (Xj)jgN is the process (f/n)neN* of D([— oo, oo]'^)-valuecil 
random variables 



given by 



Un '■— {Uniti, . . . , tci))(^ti,...,ta)e[~oo,oo]'' 



1 " 

Unih, :=-/^ 5Z(in,ti[-oo,t,](^*) - Ein,ti[-oo,t,](^o)). 

* 1=1 



The study of the weak convergence of such a process began with Donsker [10| , who proved 
convergence of the empirical process to some Gaussian process in the case of i.i.d. M-valued 
data. Donsker's result has been extended to sequences of weakly dependent (M or M'^-valued) 
random variables by many authors. Among others, it shall be remarked that Billingsley j2| 
gave a result for functionals of (/^-mixing sequences, Berkes and Philipp jH under strong mix- 



ing assumptions, Doukhan, Massart and Rio [12| for absolutely regular sequences, Borovkova, 
Burton and Dehling for functionals of absolutely regular processes, Doukhan and Louhichi 



111 ], and Dedecker and Prieur [6|] for new dependence coefficients. 

The technique of the proof usually consists of establishing finite- dimensional convergence of 
the process and to use an appropriate moment bound to get tightness of the process (see j^). 

In the recent paper j^, the authors introduced a new approach which is useful when the 
required properties on the underlying process are only established for a class of functions not 
containing the indicators. The required conditions are the Central Limit Theorem and a bound 
of the 4-th moment of partial sums for the process (/(Xj))j>o, when / belongs to the class of 
Lipschitz functions. Under these conditions, in the case of M-valued data, they were able to 
prove an empirical CLT. Later, in (3], the technique was adapted to treat the case of M"^- valued 
data and using the class of Holder functions. In that case bounds on higher moments are 
needed. 

These required conditions can be satisfied in cases where the data arise from a dynamical 
system. In particular, for a large class of dynamical systems, they can be derived from the 
study of the so called Perron-Frobenius operator. More generally, they can be established in 
cases where the system presents some multiple mixing properties (see Section [2] and 0] for more 
details). 

The aim of the present paper is to give a very general setting under which the technique 
of jl] and [3] can be applied. In this way, we obtain extensions of the previous results. In 
particular, we show that the approach of jl] and [3] can be applied with more general classes 
of functions than Lipschitz and Holder functions. We provide general conditions on the class 
of functions for which the CLT and moment bounds have to hold. In addition, we use a more 
general moment bound, balancing conditions on the distribution of Xq with properties of the 
class of functions. 

Our results allow us to handle processes with weaker moment bound than in previous works. 
In particular, we are able to treat systems satisfying a multiple mixing property with polynomial 
rates, whereas in 0] exponential rates were required. As a concrete application, we obtain new 
result for causal functions of i.i.d. processes. 



^Let IWJ— oo, oo]"^) be the space of generalized multidimensional cadlag fmictions [— oo, oo]'* — > Mjfor definition 
see If d. p. f 2861). equipped with the multidimensional Skorohod metric do as introduced in [fy, p.1289] (see 
also [l7|). Note that (D([— oo, oo]''), do) is a complete and separable space (more precisely, [16[ and |f 7| 
proved this for the space D([0, f]''), but - since [0, f] and [—00,00] are homeomorphic - the metric on 
D([— 00, oo]'') can naturally be extended to a metric on D([— 00, oo]'') which conserves all relevant properties 
(c.f. 0, p.lOSff.])). 
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2 Central Conditions and Statement of Main Results 



2.1 Conditions 

Before coming to the statement of our main results, let us have a look at our conditions, what 
they are needed for and some example of how they can be established. 

As pointed out in the introduction, the present paper presents a technique which differs from 
the usual finite-dimensional convergence plus tightness of [/„ approach. This is useful in cases, 
where one cannot or not without great effort directly prove these conditions, but where one can 
establish similar results for functions (/(Xj))jgN of the underlying process. These situations 
appear, e.g. when dealing with data arising from Markov chains or dynamical systems (c.f. jsf 
and 0). 



2.1.1 Central Limit Theorem under a Class of Functions. 

We say that a process {Xi)i^f^ satisfies a Central Limit Theorem under a class of functions Q, 
if for every f & Q such that E(/(Xo)) = 0, there exists a'j < oo such that 

1 " 

A lot of research has been devoted to establish CLTs under various classes of functions, such 
as functions of bounded variation, Lipschitz functions and Holder functions. Hennion and Herve 
13| give a survey of such results for dynamical systems and Markov chains, where the Perron- 



Frobenius operator or the Markov operator satisfies a spectral gap condition. Another example 



are ergodic torus automorphisms, for which Leonov [15[ and Le Borgne [IJ] established CLTs for 
Holder functions. In the present paper, we consider causal functions of i.i.d. processes where 
the CLT holds for Holder functions. CLTs for Lipschitz functions were studied for random 
iterative Lipschitz models and linear function of i.i.d. processes in jsj. 



2.1.2 Moment Bounds under a Class of Functions 

To prove tightness, one usually makes use of conditions on the moments of increments of the 
empirical process. In order to restrict our conditions to functions of the process we will work 
with the following type of moment bounds under the same function space Q for which the CLT 
(HD holds: 

There are finite constants C > 0, r > 1, p G N* and nondecreasing functions $i, . . . , $p : 
Mq such that for all / G ^ with ||/||oo < 1 and all n e N* we have 

E(|E/ra-E(/(Xo))|'') 
^ 1=1 ' 

<CY^n^ ||/(Xo) - E(/(Xo))||';, $.(11/ - E(/(Xo))b). (2) 

This condition is met, e.g. for processes satisfying a multiple mixing property. 

Definition 1 (Multiple mixing property). Let (Xj)jgN be a stationary stochastic process of 
M'^-valued random variables and let ^ be a class of measurable real-valued functions defined on 
M"^ and equipped with a seminorm || ■ For integers zi, Zj, we write := . -^iy We say 
that (Xr^nm is 0,r-multiple mixing with respect to Q if there exist a constant r G [1, oo) and 
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a nonincreasing function : N — > Mq such that for any p G N* there is a constant Kp < oo 
satisfying: 

|Cov(/(Xo)/(X,.) ■ . . . ■ , f{X,,)f{X,.J /(X,.)) I 

<i^,||/(Xo)||.||/||ge(z,) (3) 

for all / G ^ with ||/||oo < 1 and E(/(Xo)) = alHi, . . . , ip G N, g G {1, . . .,p}. In that case 
we write (X„)„gN ^ MMQ^r{G)- 

The following proposition shows that multiple mixing systems satisfy a 2p-th moment bound 

Proposition 1. Let [Xn)nen G MMe,r(^) for a function B such that there exists p G N* 
satisfying 

oo 

Y^^^^'^^i^ < oo. (4) 

Then there is a C > such that ([2]) holds for all f ^ Q such that \\f\\oo < 1, with r and p as 
above and = x\ 

The proof of Proposition [1] will be given in Section [51 

Note that similar moment bounds have been obtained in [3] under the stronger assumption 
of multiple mixing with exponential rate, i.e. when Q{i) decreases exponentially. Under this 
assumption, one can get sharper moment bounds, with = log^^~*(x +1). The moment 

bounds obtained in the present paper are sufficient to apply Theorem [H and thus our general- 
ization allows one to treat processes that are multiple mixing with polynomial rate. 



2.1.3 Approximation of the Indicator Functions 

Conditions ([T]) and ([2]) refer to the processes (/(Xj))jgN for / G ^. In order to obtain results 
for the empirical process Un, we need to approximate the indicator functions occurring in the 
definition of Un by functions from Q. To describe the quality of this approximation with respect 
to II ■ II g, we introduce the upcoming definition. 

In the following, <, <, ... used in M.^ are to be understood component- wis^ and sets such 
as {x G [— c>o, 00]"^ : a < X < b} are denoted by (a, b]. We will also use the notation Wg for the 
modulus of continuity of a real-valued function g, which is defined by 

Wg{6) := snp{\g{t) - g{s)\ : s,t eR"", \\t - s\\ < 6}. 

Definition 2 (^-F-control function). Let Q be some vector space of real- valued functions de- 
fined on M"^, equipped with a seminorm || ■ ||g, and let F denote the multidimensional distribution 
function of an M*^- valued random variable X. We call a nondecreasing function : M.^ — )■ M.^ 
a ^-F-control, if for every a < b E [—00, oo]'^ there is a function ^P{a,b) ^ Q such that for any 



and such that 



l(-oo,a] < ^{a,b] < l(-oo,6]- (5) 



^ mm WF^bi ~ ai) ' 

:=l,...,d 



^i.e. for a — (oi, . . . , a^), b — (bi, . . . , bd) € [~oo, 00]"^ write a < b ii and only if a; < bi for all i = 1, . . . , d 
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where Fi denotes the i-th marginal distribution function of X. 

If such a function \l/ exists, we say that Q approximates the indicator functions (of rectangles 
[-cx),t], t e R'^) with ^-F-control ^. 

Example 1. As an example consider the class of bounded a- Holder functions "Hq, equipped 
with the ct-Holder norm 



oo + sup<! IT^ : x,y eW^, x^y\. 



\x-y 



a 



Choose </?(a,fe) G 'Ha as 

Xi — h. 



^{a,b) {Xl,...,Xd):=W^ (^l(-oo,oo)2 (cti, k) 



1=1 



where (yj : M — )■ M is given by (p{x) = l[_oo,-i](a;) — a;l(_i,o](a^)- Obviously this choice of (p{a,b) 
satisfies ([5]). Let us now check condition ([6]). Since for all j = 1,. . . ,d, WFj{S) < wf{S), we 
have 



bj — dj > inf{5 > : Wf{5) > min WPiibi — Oj)}. 
Thus, by the definition of (p(a,b) we obtain 

\\'f{a,b)\\H^ < d max ■ ^ ^ + 1 

j=i,...,d [Oj — aj)"^ 



< d(^wp min ^Wpiibi - tti)^^ + 1, 



where wp{y) := inf|(5 > : wf{S) > y}. Hence ([6]) is satisfied for the nondecreasing function 
given by 

m:=d(w^(-)Y\l (7) 



and thus defines an Ha-.F-control, which gives us the following lemma: 

Lemma 1. The space of bounded a-Holder functions Ha approximate the indicator functions 
with Tia-F- control given by ([7j). 



2.2 Main Theorems 

Our main result is the following: 

Theorem 1. Let (Xj)jgN be a stationary process ofW^-valued random vectors with continuous 
multidimensional distribution function F . Assume that there is a vector space Q of measurable 
functions — )■ M, containing the constant functions, equipped with a seminorm || ■\\g, satisfying 
the following conditions: 

(i) For every f & Q such that ||/||oo < oo, the CLT ([T]) holds. 

(a) Q approximates the indicator functions with Q-F-control ^ . 
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(in) There are constants r > 1, p > rd, 71, . . . , 7p satisfying 

< 7i < ^ + 2(p-z) for alii = l,...,p, (8) 
and some nondecreasing functions $1, . . . , <l>p : Mg ~^ ^0 satisfying 

$i(2*(^)) = asz^oc, (9) 

such that for every f E Q with ||/||oo < 1 the moment bound ([2]) holds. 

Then there is a centered Gaussian process (W^(t))tg[_oo,oo]'* with almost surely continuous sample 
paths such that f/„ W , in the space D([— 00, oo]''). 

Remark 1. In fact, the functions $1, . . . , $p and the function \I/ only have to be nondecreasing 
for sufficiently large arguments. Note that condition ([2]) has only to be satisfied for a certain 
subclass of see Remark [51 

As a consequence of this abstract theorem, we can give a statement for multiple mixing 
processes, for which conditions are more easily verifiable. 

Theorem 2. Let (Xj)^^^ be a stationary W^'-valued process with continuous multidimensional 
distribution function F . Assume there is a vector space Q of measurable functions — t- M, 
containing the constant functions, equipped with a seminorm || ■ \\gthat satisfies the following 
conditions: 

(i) For every f & Q such that ||/||oo < 00 the CLT holds. 

(a) The process (Xj)jgN. is Q,r-multiple mixing with respect to Q for some r > 1 and a 
: N — )■ , such that there exists a p > dr satisfying Xli^o ^^^~^®(^) ^ 

(Hi) Q approximates the indicator functions with Q-F-control \l/ such that '^{z) = 0{z~) for 
some 7 > 

' p—rd 

Then there is a centered Gaussian process {W{t))f^[_^^^-^d with almost surely continuous sample 
paths such that Un — > W , in the space D([— 00, 00]''). 

Proof. By Proposition [1], ([2]) holds with = x*. Then, taking 7^ = ^, the assumptions of 

Theorem [T] are satisfied. □ 
The rest of the paper is organized as follows: In Section [3] we present some particular cases 
of the theorem and some applications. The proof of Theorem [T] is given in Section HI Section 
O is devoted to the proofs of the results of Section [31 

3 Applications 

While Theorem [His stated in a very general context, this section is devoted to the special case 
where Q = Ha, the class of bounded a- Holder functions. We will first obtain a corollary to 
Theorem [T] specifying the conditions for this choice of Q. As an application, we will study 
empirical processes of causal functions of an i.i.d. process. 
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3.1 Assumptions on Holder continuous functions 

The case of Holder continuous functions has aheady been considered in 0]. In the present 
paper, we obtain generahzations of the results in 0] , by allowing a larger class of functions $j 
in the moment bound ([2]). In this way, we are able to treat processes that satisfy a multiple 
mixing condition with polynomial decay, rather than the exponential decay considered in j7|. 

Theorem 3. Let (Xj)jgN be a stationary W^-valued process with continuous multidimensional 
distribution function F . Assume that: 

(i) For every f eUa the CLT ^ holds. 

(a) There are constants /3 > 0, 7 > 1, r > 1, p > rd, ni, . . . , Kp > 0, A > 1, Zq & M"*" and an 
invertible increasing function $ : M^j" — > satisfying 

wpiy) < my-T\ (10) 



Ki <-f(^^ + 2{p-i) - d^ i = l,...,p, (11) 

$(22) < A<l>(^), \/z > zo, (12) 
such that for all f G Tia with \\f\\oo < 1, the moment bound ([2]) holds with = . 

Then there is a centered Gaussian process (W^(t))tg[_oo,oo]d with almost surely continuous sample 
paths such that Un — ?■ W , in the space D([— 00, 00]"'). 

Proof. Using Lemma [H it is sufficient to show condition ([9]) of Theorem [1] for the function 
defined in ([7]) and for suitable 71, . . . , 7p satisfying ([8]). 
By (|TOi) . for 2 > we have 

^f{^) > inf{x > : /3($(x~°))~^ - i) " ^^^{^ ^ ° ' '^(^"") ^ {^^V] 
and therefore, since $ is invertible, we obtain 

Wf(1) > infjx > : X > ($-^((/32)^))""| " = (^(/J^)^). 
Using f fT2|) . this yields that there is a finite constant C" G M such that 

<D,(2^(2)) = (2d(wp (^) ) " + 2) 

< (^^2d^-\i^z)^) + 2)y 
<C"f$($-i((/3z)^)))" 



for every i G {1, . . . ,p} and all sufficiently large z. Here, by ffTTjl . each exponent 7^ = Kj/7 is 
positive and strictly smaller than i/r + 2{p — i) — d. Thus conditions and of Theorem [T] 
are satisfied. □ 
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Remark 2. We will now show that by taking = log(x + 1) and special choices of the 

constants, the main results of 0] and [sl can be obtained as corollaries of Theorem [31 Note 
that this ^-function arises in ([2]) when the process is multiple mixing with exponential decay 
(see For the above choice of $, f lTOj) can be simplified to 

WFiy) < /3\\ogiy)\-'' 

for some f3 > 0. 

1) If we choose Kj = 2p — i, we get 

2p — i rp 



max 



i=i,...,p 1 jf- 2{p - i) - d p-rd 

and thus condition fllip in Theorem [3] is equivalent to 7 > In this way, we obtain 

Theorem 3 in 0, p. 1081]. 

2) If we choose a,d,r = 1 and p = 2, condition ( ITT]) in Theorem [3] reduces to 7 > max{^, K2}. 
Thus we obtain Theorem 1 in li, p.3702]. 

This shows that Theorem [3] is a far-reaching generalization of the result obtained in (3] and jsj . 

We finally obtain a version of Theorem [2] for the special choice Q = Ha- 

Corollary 1. // conditions and of Theorem\^ hold with Q = Ha and if F is d -Holder 
for some d such that 

- > (13) 

a p — rd 

then the empirical CLT holds. 

Proof. We will apply Theorem [3] and thus have to verify assumption Choosing Hi = i and 
$(x) = X, we obtain the moment bound ([2]) by Proposition [H while fll2p is obviously satisfied. 
Choosing moreover 7 = ^, fill I) follows from fll3p . Finally fllOp is a consequence of the Holder 
assumption on F. □ 

3.2 Causal functions of independent and identically distributed processes 

One example of processes that feature the multiple mixing property ([3]) and that can be treated 
by our methods is the class of causal functions of i.i.d. processes, which are defined as follows: 

Definition 3 (Causal function). Let (^j)jez be an independent identically distributed process 
with values in a Banach space X. We call (Xj)jgN a causal function of (^j)jez if there is a 
measurable function G : M'' such that each Xj is of the form 

'■= G'(('Ci-i)ieN)- 

Let us now introduce a measure of the dependence structure of a causal function of an i.i.d. 
process Set 

'■= G{^i^ 6-1) • • • ) 6) ^-1' • • •)) 

where is an independent copy of i-e. (■CjOjez and (^^jez are identically distributed 

and both processes are independent from each other. We can now define for i G N* and s > 1, 

5,,, = \\Xi - := Ef ||X, - X,||^,) (14) 



This physical dependence measure was introduced by Wu [18 
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Proposition 2. Let (Xj)jgN be an W^-valued causal function of an i.i.d. process, a G (0, 1] and 
r G [1, oo), s G (1, oo] with 7 + 7 = 1- Then 

where G(z) = (5i,s)°. As a consequence of Proposition^ if 

00 

Y,^'P~'{6,,sr <oo (15) 

/or some p > rd, then the moment bound holds for all f G Ha such that \\f\\oo < 1? with 
p,r as above and $j(x) = x*. 

The second crucial point in the assumptions of Theorem [T] is the CLT ([1]). The following 
proposition gives a criterion for ([1]) in the situation of a causal function of an i.i.d. process. 

Proposition 3. // (Xj)jgN is an W^-valued causal function of an i.i.d. process and satisfies 

00 

Y^iksT < 00, (16) 

i=l 

for some a G (0,1], s G [l,oo], then the CLT ([1]) under Tia holds with aj = E(/(Xo)^) + 

2Er=MfiXo)f{x.)). 

The proofs of the two preceding propositions are given in Section [51 As a direct application 
of previous results, we obtain the following one: 

Theorem 4. Let (Xj),jgN be an W^-valued causal function of an i.i.d. sequence. Assume that: 
(i) The distribution function F of Xq is d -Holder for some d G (0, 1]. 

(ii) There are some r G [l,oo), s G (l,oo] satisfying ^ + ^ = 1, an integer p > rd and a 
positive constant a G (0, 1] satisfying f[T^ and f[T51) . 

Then there is a centered Gaussian process (W^(t))tg[_oo,oo]d with almost surely continuous sample 
paths such that Un — ?■ W , in the space D([— 00, 00]"'). 

Proof. We will apply Corollary [TJ By Proposition [3] the CLT ([T]) holds under Hq,. Proposition 
[2]shows that (X,)ieN e MMe,,.(H«), where = (5^,,)" and thus E*=o^^^"^0(O < oo- □ 

Example 2 (Time delay vectors). Let (Xj)jgisj be a real- valued causal function of an i.i.d. 
process. We define the time delay vector process (li)jgN of dimension ci > 1, by 

Yi = {Xi,...,Xi+d-i), ieN. 

If the scalar process (Xj)jgN satisfies (ji]) and (jii]) of Theorem HI then the Empirical Central Limit 
Theorem holds for the process (yi)jgN- 

Proof. Assume that {Xi)i^^ satisfies and ([n]) of Theorem H] and let us check that the process 
(Fj)jeP} also satisfies these assumptions. Denote by Fx the distribution function of Xq and by 
Fy the multidimensional distribution function of Yq. The marginals of Fy are all Fx and then 
< dwpx- Thus Fy is Holder. Denote by 5i,s(X) and Si^siX) the coefficients introduced in 
( IT^ relative respectively to (Xj)jgN and (Fj)jgN. We can see that there exists a constant C > 
such that for alH G N, 

SiAY) < C{6,AX) + . . . + 6,+d^iAX)). 
Thus, we infer that (li)igN satisfies f[T^ with the same constant a as for (Xj)jgN. □ 
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Example 3 (Linear processes). Let (Xj)jgN be a causal linear function given by 



where (^j)jgz is an i.i.d. A'-valued process and ( family of linear operators from X to 

M"^. We denote the norm of such operators by 



<!}■ 



\a\ = sup{||a(x)|| : X G A", \x\ 
If II 'Co lis < for some s > 1, if the distribution function F of Xq is i^-Holder and if 

r {2p — l)p 



E 



with b > min 



peN,p>rd -d p — rd 



for r = then the Empirical Central Limit Theorem holds. 

Proof. Let {Cj)ji=z be an independent copy of and p an integer which realizes the mini- 

mum in the condition on b. By assumption, there is an e > such that b > {1 + ^)'^|~~^- We 



can choose a = 13(1 + e) 



-1 p— rd 
rp ' 



ensuring that fll3p is satisfied. Since 



we have 



j=i 



\aj\, 



j=i 



< (2||eo||.)"^'^"' 



j=i 



C(z 



2p-2~ab\ 



where 2p — 2 — ab < 2p — 2 — {2p — 1) = — 1, thus (fT5|) holds and Theorem |4] applies. □ 
The example of causal linear processes has already been studied by several authors. Dedecker 
and Prieur |6[ could allow lower rates of convergence for Yl^=i kjl but required that Xq has a 
bounded density. Wu [l9| also assumes that the underlying i.i.d. process has a density. In the 
present paper, no assumption is made on the distribution of the except moments and the 
distribution of Xq does not need to be absolutely continuous. In the case where are M- valued 
and d = 1, very weak conditions can be found in [5|. 



4 Proof of Theorem [T] 

To prove the convergence of the empirical process we will use the following result obtained in js]. 
Theorem 2]. Note that this result is a modification of a classical theorem on weak convergence; 
see Theorem 4.2]. 

Proposition 4. Let S he a separable and complete space with metric p. IfUn,ul^^ and U^'^\ 
n,m & N*, are S-valued random variables such that 

Ui^^ A f/^") as n ^ oo, for all men* and (17) 
lim limsup P(p(t/„, f/^""^) > e) = for all e > 0, (18) 

then there is an S-valued random variable U such that Un — > U as n ^ oo and U^"^^ U 
as m ^ oo. 
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Remark 3. We will apply Proposition |4] to the situation where S is chosen as D([— oo, oo]'') 
(equipped with the Skorokhod metric rfg, c.f. pH]) and t/„ denotes the empirical process. If 
one wants to prove the convergence in distribution of Un Proposition H] assures us, that it is 
sufficient to find a process f/n"*^ which approximates f/„ as m — )■ oo in the sense of f|T8|) and to 



show that this process is convergent in distribution for each m as — oo. 

Following the techniques presented in 0, p.1078 ff], we begin by introducing a partition for 
[—00, ooY- Let Fi be the i-th marginal distribution of F, = Tq™'' < r^'' < . . . < rln '^ = 1 a 
partition of [0, 1] and set for z G {1, . . . , d}, ji G {0, . . . , m}, 



:= i^-(r;™) 

where F[^{y) := sup{x G [—00, 00] : Fi{x) < y}. 

;ti 

For j G {0, . . . ,m + l}'' set 



Note that F[^ are injective since F^ are continuous. For convenience we also define t-™Vi '■= ^t^m- 



To keep notation short, denote {x, . . . ,x) G [—00, 00] by x. 

We can construct a ^-approximation of the indicator function lj__^(m)j by setting for j G 

{l,...,mY 

^f^:=l''m^^^ (19) 
[0, ifj^2, 

where v^//™) Am), G Q satisfies ([5]) and ([6]). Observe that t''.™^ < t^"%, since all F^^ are injective. 
To approximate the empirical distribution function we introduce 

iG{i,...,m}'* j=i 

Note that for t in any fixed rectangle [t^^\,t^J^^) we have the simple form 

J ^ ^ 

1 " 



n 

i=l 



By the definition of the (p^J^'' it is easy to see that therefore 

i^n(tf_t) < Fi-\t) < F„(t(.™)) w G [tj.7},tf 

Thus it is natural to approximate (as m 00) Un by 

:= (v^(F^)(t)-F(-)(t)) 



where 



tG[— 00,00]' 



F(™)(t) := E(Fr)(t)) = E(v.f )(Xo))l(,(.)^,(™))(t). 

jG{l,...,m}'' 
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Remark 4. Notice that at this point the v?^'"'' and thus f/jl*"^ depend heavily on the chosen 
partition tq, . . . , on [0, 1]. Therefore the notation with the superscript m may be misleading 
at first glance, but since whenever the choice of the partition matters we will only use equidistant 
partitions of [0, 1], the partitions will in all relevant situations be uniquely defined by m. 

The central idea to prove Theorem [1] is to use Proposition |H Thus we need to check f|T7j) 
and f|T8l) for 5* = D([— oo, oo]'^). This is done in the next two lemmas. 

Lemma 2. For every partition = Tq™'' < . . . < r^^^ = 1 of [0, 1], converges weakly to 

some centered Gaussian process W^"^^ E D([— oo, oo]'^) whose sample paths are constant on each 
of the rectangles [t^"^\, t^"^^), j G {!,..., rriY. 

3 ^ •' 



^n™^ are constant on ea"^ ^^^^-^^nr^^r. r+(™) 

weak convergence of the sequence of vectors 



Proof. Since all the Un are constant on each of the rectangles [t\^j,ty' ), it suffices to show 

J ^ ^ 



1 ^ 



iG{l,...,m}d 

which is a consequence of the CLT ([1]) and the Cramer- Wold device. □ 

Lemma 3. Let = rj^^ < < . . . < rln^ = 1 be the partition of [0, 1] defined by r^™"* = ^. 
Then for every e, 77 > there is a nio G N* such that for all m > mo 



hm sup P ( sup \Un{t)- U!^^ it) I > e) 



< 



00,00 



Proof. Let us consider e, 77 > fixed for the rest of this proof. Consider the partition = 
< . . . < rln^^ = 1 of [0, 1] defined in the statement of the lemma and set h = j^. For each 
G N*, consider the refined partition 



of [r^™!, Tg"*^], where 



Am) _ (k) (k) (k) _ fn,) 

' q-l ~ ^q,0 ^ ^q,l ^ • • • ^ ■'^ 2''- ~ q 



^q/ ■- ^q-1 + ^ 2k'- 



G {0, . . . , 2''} and g G {0, . . . , m}. Setting for z G {1, . . . , d}, jj G {1, . . . , m}, G {0, . . . , 2^} 



we obtain partitions 
of \tt^]-i-,t^i^]]- To simplify the notation in the following calculations we set 



Am) _ (k) ^ (k) (k) _ Am) 



Let us now focus on a fixed rectangle [t^^\,t\'^^) for some j = {ji,. . . ,jd) G {!,... ,m}'^. 

Our aim is to construct a chain to link the point t'^^j to some arbitrary point t G 
Therefore we set 

li,jXk,t) = max{£ G {0, . . . ,2^=} : sgj^, < t,} G {0, . . . , 2^^ - 1}. 
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Since we consider j to be fixed, we may drop the index j in order to simplify furtlier notation. 
More precisely, we set 

:= (^Sji,«i'---'4jLiJ' and l{k,t) := {hj^{k,t), . . . ,ld,j^{k,t)). 

In this way for any k G N*, we obtain an ([— C)0, oo]'^- valued) chain 

,(m) _ (0) ^ W <r <r '^''^ <r -f <r '^^^ 



Now set 



',(0) 



/ \^ J 



and choose for every A; G N* and / G {0, . . . , 2^= + 1}'^ a function ^/'f ^ G G such thatEl 



if 3i G { 1 (i} : ji = 1 and k = 

if {3i G {1, . . . , 4 : ji = m and h = 2^ + 1) 

and ($i E {1, . . . ^ d} : ji = 1 and /j = 0) 



(20) 



(f (k) (k). else. 



where (k) satisfies ([5]) and Qj. 

By this definition we have for every t G [— oo, oo]'^ and / G {0, . . . , 2'^}'^ the following inequal- 
ities: 



^ „/,{l) ^ ^ jik) ^ ^ , (k) 



l{k,t)+2' 



(21) 



(22) 



tion 



Using inequality (122]) we obtain for t G [t^^j,t^P^) and K eW, the telescopic-sum representa 

i=l 

K ^ n T ^ 



(23) 



fc=l i=l 

Let us now consider 



Unit) - Ut\t) = v^(i J2 M-^,t]m - m) - V^{Ft\t) - F(™)(t) 

1=1 



Equation f l23|) yields 



fc=l i=i 

1 " 

* i=l 



(24) 



*the reference to the indices j and m is omitted, since these are considered to be fixed. 
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Applying the inequalities in ( 122|) . we gain the following upper bounds for the last sum on the 
right-hand side of the above inequality: 



* i=l 



(25) 



and 



^ i=l 

1 " 



(26) 

For convenience, let s^.^^ 2j=+i •= ^^-^^ o*- equation (12T|) and the continuitjH of F, we obtain 



^/^EV;(^)^^^,(Xo)-E4^),)(Xo) 



'i(if,t)+2 



_)(Xo) - El[„^,,^^^^^j__)(Xo) 



< a/ti E1[„— , 

< \/n\d max 

V i=l,...,d^ 

and thus, if we choose 

K = K, 

we obtain 



3d^/nh 
2^ ' 



■=2- 



In summary, using (125|) . ( 126|) and ( 128|) in equation ( l24l) yields, for all n G N*, 



(27) 



(28) 



\u^{t) - ujr\t)\ < 



5:4jE{«o(^.)-e<' 

k=l ^ i=l ^ 

-(<4t)(^^)-E<-i)(^o))} 



+ 2- 



(29) 



Consider the maximum of the terms in (1291) over all t G [t^'^.tf'^). By the definition of the 



/(A;, t) we have 



l{k,t) 












2 




2 


, . . . , 


2 





/(fc - l,t). 



^notc that for continuous F, we have F o F^{x) = x for all x £ [0, 1]. 
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We therefore obtain 



sup 



\Unit)-Ul^' 



^-^ Jn «e{o,...,2'=-i}rf 1 V / 

k=l i=l ^ 



(fc-i). 



= max 

n «G{0,...,2'f"-l}<^ 



+ 2- 



Choose £fc = ^f^fj,^^-^ and note that Yl^=i^k = £^/4. An apphcation of Markov's inequahty for 
the 2p-th moments combined with condition ([2]) imphes 



P( sup \Un{t)-U't\t)\> 

E p(^e{(W"w-e>a,'"(^o)) 



/G{0,...,2'=-1} 



(4-J'(a-<)-e4-J'(a-„)) 

E p(4iE{W5'»)-e<^'(a-„)) 

or<-„ nrf ,_i 



S2CE E 

U=l /G{0,...,2'=-1}'« k 



> 



42p 



i=l 



+ E 

iG{0,...,2^"-l}<* 



^2p^p 



(30) 



The critical part in these terms is the argument in the functions $i. We therefore collect the 
necessary auxiliary calculations in the following lemma: 
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Lemma 4. For all I e {0, . . . ,2^ - 1^, k, 



llW5^(xo)-v^f"^(xo)||.<(^)^ 

||^P||g<max|v^(^). 



Proof. By (1211) and the continuity of the Fj, 

ll^f^(Xo) -^[^-f (Xo)ll. < 111 (Xo) - 1. ,,,(.-1) ](Xo)||. 

L / J I'll I ' [;/2J -iJ 

<(rfma^;i^(.;ij-i^(.a,.-3))) 



/?>dh \ f 



The second inequahty can be proven in a similar way. 

In the first two cases of the definition (1201) . ijji is a constant function taking either the value 
zero or one for each argument. In this cases the last inequality of the lemma is trivially satisfied 



by the conditions on || ■ ||g. Else t/'P^ has a representation (f. (k) (k)y where 



(fc) _ ( Sk) Jfc) 



(fc) _ fjk) Ak) 



and hence, for every i G {1, . . . ,d}, 

^a. - e{5 > : 3t e M, |i^(t) - F,{t - 5)\ > h2->^} 

C {6 > : WfX^) > h2^''} (31) 

To see this, set 6 = {s['^^'') — {s['^^^-^) > 0, t = F[^{s\'^^) and recall that the F[^ are injective. 
Now condition yields 



1 \ /2'' 

< * — 



/ (k) (k) \ — \ h J' 



since mini=i,...,d Wi.^ (43, - - by ([SI]). □ 
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An application of Lemma H] to (130|) yields 

Pf sup \Un{t)-Ut\t)\>e) 



, k=l 1=1 



$i 2$ 



i=l ^4'' 



h 



i=l I fc=l 

Y,2^'^-"^'k'^%{2<il[^))0[ (32) 

for every j G {1, . . . , m}'^, where D > denotes some finite constant. In the second inequality 
we used that and $i are nondecreasing functions and e/A > eK„- 

Let us first deal with the term in the last line of (132|) . By condition (|9]) we have 

fc=l k=l 

where ■jp < ^ — d. Hence there is a nonnegative constant D' < 00 such that 

J22^''-r^'k^P%(2^(^j^y' < D'h'-^^ = o{h''). (33) 

fc=i 

Now consider the first summand on the right-hand side of inequality fl32|) . In fl27|) we chose 
ii'n = Llog2(2'^(iy^/i/£:)J , hence condition ^ yields for any z = 1, . . . ,p — 1, 

< D"log^^+^(^v^/l) ■ (v/^)^-(^+2(p-.)-d);^d 

for some nonnegative constant D" < 00. Since 7i < ;^ + 2(p — i) — d for i = 1, . . . ,p — 1, by dH]) 
we obtain for all r/ > and sufficiently large n G N*, 

< \^h'. (34) 

Finally, by (ESD, dMD and (El]), for any r/ > 

lim sup P ( sup \Un{t) - U^^ {t) I > e] 



< lim sup P ( 

'j^{\...,mY 

< m'^{o{h'^) + ^r//i^ 



_ sup |f/.(t)-f/^H^)l >^ 



m'^[o{m "') + ^r/m 
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since h = 1/m. Hence there is a mo G N* such that 

hm sup P ( sup I Un{t) - t/^") (t) I > £ J <ri 

for all m > rriQ. □ 
With Lemma [2] and Lemma [3] established, let us finally prove Theorem [H 

TheoremUl By application of Proposition H] on D([— oo, oo]'') equipped with the Skorokhod 
metric p, Lemma |2] (with r^'"'* := ^) and Lemma |3] show that Un converges in distribution to 
a process W which is also the limit process of the sequence 

lYim)^ m e N*. Since all W^""^ are 
centered Gaussian processes the limit process must also be centered Gaussian. 

It remains to prove the continuity of the sample paths of W. At this point we already know 
that Un converges weakly to W. Therefore it is sufficient to show that for every e,ri > 0, there 
is a 5 > such that 

limsupP( sup \Un{t) -Unis)\> 3s) <3r]. (35) 

The sufficiency of this condition can be proven exactly the same way as in the proof of Theorem 
15.5 in g p.127 f.]. 

For all m G N*, by some triangle inequality arguments we obtain 



limsupPf sup \Un{t) — Un{s)\ > 3e 

< 21imsupP(sup \Unit) - f/^"H^)l > ^) 
+ lim sup P ( sup I f/^™) (t) -V^;^\s)\>e 

and thus, by Lemma [31 there is a mo € N* such that for all m > mo. 



limsupPf sup \Un{t) — Un{s)\ > 3e 

<2r] + hm sup P ( sup | f/^™) (t) - U^""^ {s)\>e). (36) 



\\t-s\\<5 

Now set Sm '■= \ Hiinje{o,...,m}'*|KiciXj=i^,,,^d | ^^^d observe that 5m is strictly positive for 

any m G N*, since the used in the construction of the tj are strictly increasing. Obviously 
for all 5 < 5m and \\t — s\\ < 5, the points s,t E [—00,00]*^ must be located in adjacent (or 
identical) intervals of the form [tj,tj_j). Since the process u!{^^ is constant on any of the 
intervals [tj,tj_j) and by symmetry in the arguments s,t we obtain 

sup \ujr\t) - Ut\s)\ = m^x - Ujr\t,^,)\, 

||t-s||<<5 jG{0,...,m}'' 

2G{0,1}'*, j>z 

thus 



P( sup |f/M(t)-f/M(s)|>e 
< 2'^(m + l)-^ max F(\UtHt,) - Ut\t,^.)\ > s). (37) 

2G{0,1}'*, j>z 
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Recall that the functions tpf^^ are defined in f|T9|) . Analogously to the calculations in Lemma HI 
one can show that for all j G {0, . . . , mY and z G {0, 1}'^ such that j > z, we have 



llv^J.^jllg < max|^(m), 



Then, by applying one after another Markov's inequality, the 2p-th moment bounds ([2]) and 
the preceding inequalities, we obtain 



P[\Ut\t,)-Ut\t,..)\>e 

n 
i=l 

i=l 



2p 



1=1 

p-1 

1=1 



where D is some finite constant. Therefore by f l37p there is another finite constant D' such that 

p-i 

\\t-s\\<5 



P(^ sup |f/^™Ht) - Ut\s)\ >£) < D'm'^(m^''~r + ^ „-(P-*)m^'-^ 
and thus 

limsupP( sup \Ui"'\t) - U^"'\s)\ >e) < D'm'^-^'r-'^^ < r] 
for sufficiently large m G N*, say m > mi. By ( 13 6 p this implies that f l35p holds for 6 = 

^max{r?io,mi}- I— I 

Remark 5. We saw in the proof, that the theorem also holds if ([2]) is only satisfied for a certain 
subclass of functions in Q, more precisely if holds for all functions f E Q of the form 

/ := ^{a,b) - ^{a',b'), 

where a, b, a', b' G [—oo, ooY, a' < b, are such that 

P{Xo G [a', b']) < 2P{Xo G [a, b]) < P{Xo G [a', b]) < 3P{Xo G [a', b']). (38) 

Choosing for each m G N* an := f{a,b) — V{a',b') such that (155]) is satisfied for P(Xo G 
[a', 6']) = 1/m, it can be shown that 



m 1 1 5 j 
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5 Proof of Proposition [H Proposition [2] and Proposition [3] 

5.1 Proof of Proposition [T] 

By stationarity, we have 



E 



n 

((E/(* 

i=l 



J2 E(/(X,J ■ . . . ■ 

l<ii,...,ip<n 

<p\n\ Yl E(/(Xo)/(X,*) 



0<ii,...,ip-i<n— 1 



Using the notations /„(0) := |E(/(Xo))| = and 



Up):= Y1 |E(/(Xo)/(X,*)-...-/(X,;)) 



0<ii,...,ip<n~l 
ip<n—l 



for p G N*, we therefore have 



n 

|e((^/(X,))')| <p\nl4p-l). 

4 = 1 



Decomposing the sum in fl39l) with respect to the highest increment of indices ig, q G {1, 
we receive a bound 

p 

In{p) < ^Mp^q), 

9=1 

where 

n-l 

Up, q) = J2 E |E(/(Xo)/(X,.) ■ . . . ■ /(X,;)) |. 

iq=0 0<il,...,iq-l,iq+l,...,ip<iq 



Lemma 5. Lei (X„)„gf^ G MMe,r(^)j ^^en /or a// p G N* snc/i i/iai 

oo 
1=0 

and all q G {1, . . . ,p} i/iere zs a constant K' such that 

Up, q) < K'\\f{X,)Uf\\g + nh{q - 1)Up " q) 
for all new and f eQ. 
Proof. Set 

A. 



H'^,...,lp ■ 



B. 



i\,...,ip ■ 



Cov(/(Xo)/(X,.) ■ . . . ■ /(X,._J , f{X,.)f{X,.J ..... /(X,.)) I 
E(/(Xo)/(X,*)-...7(^.*J)Me(/(Xo)/(X,^J-...-/(^.-.*))| 
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where we used the stationarity of (Xj)igN in the last hne. We have 



n-1 

iq=0 0<il,...,iq-l,iq+l,...,ip<iq 

i*<n— 1 



n-1 



Ai,...,ip + ^ 



E 



Si 



ig=0 0<«i,...,i5_i,i5+i,...,ip<ig 



An apphcation of the multiple mixing property ([3]) yields 



n-1 



n-1 



E E 

iq=0 0<il,...,iq-l,iq + l,---,ip<iq 

i*<n—l 



ia=0 



<i^'||/(Xo)||.||/||g 



for some constant K' < oo, since YlT=o'''q < C)0 by fHT]) . Finally 



n-1 



E E 



iq=0 0<il,...,iq-l,iq + l,...,ip<iq 

n-1 



i*<n— 1 



E E(/(Xo)/(X,.)-...-/(X,.))| 



49=0 l^O<ii,...,iq_i<n— 1 



J2 |E(/(Xo)/(X,,,J-...-/(X,._,*)) 



0<i5+i,...,ip<n— 1 

nlni'p- l)/„(p- g). 



□ 



Lemma 6. // G MMe,r(^) i ^^en /or all p G N* sfic/i t/iat (HT!) is satisfied there is a 

constant Kp < 00, such that 



rp/21 



(42) 



1=1 



for all f eg with ll/IU < 1 and E(/(Xo)) = 0. 



Proof. We will use mathematical induction to prove the lemma. By Lemma Owe can easily see 
that 

Ul)<K,\\f{Xo)\\r\\f\\g 
for some constant i^i < 00 if fHT]) is satisfied. Now consider an arbitrary p >2 satisfying fHTj) 
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and assume that (l42l) holds for all p < p — 1. We have 

p 

In{P) < ^Jn{p,q) 
9=1 

P 

<J2{K'\\fiXo)\\r\\f\\g + nUq-l)UP-q) 

q=l 

<K'p\\f{Xo)\\r\\f\\g + nj2K" E ^^"l/MII 

q=l i=2 

rp/21 

<KpJ2n^-'\\f{Xo)m\\l; 
1=1 

for some constants K\ K", Kp < oo, since \^] + < [f ] . □ 

PropositionUi By fHOj) and Lemma [6] we immediately obtain 



e(|5^/(X,)| ') < (2p)!n/„(2p-l) <i^pEni/(Xo) 



riM lie 



2p> 

j=l 1=1 

since (jl]) implies that fHT]) holds with p replaced by 2p — 1. □ 



5.2 Proof of Proposition [2] 

Since {Xi)i^^ is a causal function of an i.i.d. process, we have a representation 

= ^i-l, . . .), 

with G : — > M"^. Let (^j)jez and (^J )jez be copies of the underlying process such 
that all three processes are independent. Set 

•= ^i-i, . . . , ii-k+i-, i'i-k-, i'i-k-ii ■ ■ ■) 
vi^) r^fc c c c" c" \ 

and note that therefore (Xj)^^^ = (Xj-'''')jgN = (Xj-*''')jgN. We have 
|Cov(/(Xo).../(X,._J,/(X,.).../(X,.))| 

< |Cov(/(Xo) . . . - /(Xi'^)) . . . /(X|^^) , /(X,.) . . . /(X,.)) I 

+ |Cov(/(xf ) . . . fixl^l) , /(X,.) . . . /(X,.) - /(Xff ) . . . /(x|))) I 

+ |Cov(/(xf ) . . . fixl^l) , /(X|)) . . . /(X«)) |. (43) 

Since fixit^) ■ . . . ■ fixl^l) is a{{C, : j < z^^J U {{j : j G Z}) -measurable while /(X^^) ■ . . . • 

/(Xj^"*) is 0"({^j : j > 2* — /c} U {^J : j G Z}) -measurable, the functions in the last covariance 
on the right-hand side of fH5]) are independent as soon as k < ig and thus the last summand is 
equal to in this case. 
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Recall that we only consider such / that satisfy ||/||oo < 1- If we apply Holder's inequality 
to equation we obtain for r, s satisfying ^ + ^ = 1 

|Cov(/(Xo) ■ . . . ■ /(X,._J - fixH"^) ..... fixl^Jj , /(X,.) ■ . . . ■ fix,;)) I 
< 2||/(Xo) ■ . . . ■ /(X,._J - /(Xf ) ■ . . . ■ f{xltl)Uf{X,.) ..... f{X,,)l 
<2g||/(Xo)||.||/(Xo)-/(xf)||. (44) 

where we used that for Oj, 6j G [— 1, 1], 

n n n 

1=1 i=l i=l 

Since — f{y)\ < 11/11^^,11^ " vW"^ application of Jensen's inequality to (jS]) yields 
|Cov(/(Xo) ■ . . . ■ fix,* J - /(Xf ) ■ . . . ■ fixi^l) , fix,,) ..... fix,,)) I 

<2g||/(Xo)||.||/|k„(||Xo-Xril.)" 
= 2q\\fiXo)\\r\\f\\nAKsr. 

Analogously we can show that 

|Cov(/(xf ) . . . fixl^l) , /(X,.) . . . /(X,.) - /(X«) . . . /(X«)) I 

<2(|>-g)||/(Xo)||.||/|kJ|(M^ 
thus for k = iq we have 

|Cov(/(Xo) . . . fix,. J , /(X,.) . . . /(X,,)) I < 2g||/(Xo)|M|/||«J(5.„.)". 

This proves the first part of the proposition. The second part is a consequence of Proposition 

m □ 

5.3 Proof of Proposition [3] 

We will apply the following result obtained by Dedecker in 

Proposition 5. Let (Fi)jgM be an ergodic stationary process with E(Fo) = and E(Fq^) < oo, 
which is adapted to a filtration (A^j)jgi^. // 

n 

FoE(i^j|A4o) converges in Li, 

1=0 

then 



1 

—='S^Yi — ;-X(0,a^) asn-^oo, 



n 

i=l 



where = E(Fo') + 2 2(1^ • F,) < +oo. 

Proposition\^ Choose an arbitrary / G Ha with E(/(Xo)) = 0. The process (yi)jgN given by 
Yi := /(Xj) is centered, ergodic, has finite second moments and is adapted to the filtration 



6N" 
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As before, let be an independent copy of {^j)jez and set 

^'i '■= ■ ■ - j^'i, ^0, ^-1, • • •)■ 

Observe that by the independence of A^o and cr({^. : i G Z}) we have that 

E{f{Xl)\Mo) = E(/(X;)) = 0, E(/(X,)|A^o) = E(/(X;)|A^o) • 

Thus 

e{\YoE{Y,\Mo)\} < ||/||ooE{|E(/M|A^o)|} 

= II/I|ooe{|e(/(x:)-/(x;)|a1o)|} 
<ll/llooE|/(x;)-/(xo| 

<ii/iiLE|x:-x:r 

where we used Jensen's inequahty and / G Tia in the last steps. Therefore, by f|T6il . 

n 
i=l 

converges in Li and thus Proposition O applies. □ 
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